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Many tests have been conducted over-the-air using various moden protocols designed 
specifically for HF radio links. It is impractical to compare the over-the-air performance 
of the protocols, primarily because the atmospheric propagation path conditions are 
always dynamically changing (non-stationary statistics). Engineers at the Institute for 
Telecommunication Sciences (I1’S) developed a Windows program on a desktop PC to 
conduct controlled laboratory testing of modem protocols. Using this automated test 
program, we subjected the modems to a repeatable set of simulated propagation paths 
for a wide range of signal-to-noise (S/ N) ratios. The six protocols tested were: AX.25, 
AMTOR, PACTOR, SITOR, CLOVER II, and Baudot. The ionospheric propagation 
conditions were simulated by two narrow-band, Watterson model, HF propagation 
channe! simulators. Clear channel paths through the simulators and three degraded 
conditions were used: Gaussian noise, CCIR Good paths, and CCIR Poor paths. Over 
3000 data file transfers were performed in a randomized manner at various S/ N ratios 
for each of the six protocols. Both ARQ and broadcast mode were used when 
appropriate. A\ll files received with an error were preserved so an extended computer 
analysis could be performed. Two metrics were chosen to evaluate the performance of 
the protocols: 1. throughput, a measure of the data transfer rate, and 2. errors, an 
indicator of the effectiveness of the protocol. The two metric parameters are compared 
for each protocol, various channel conditions, and signal strengths. A short preview of 
the data is provided by this paper. 
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TEST COMPUTERTS) 


DATA FILES 


LOG (RECORDED DATA) 
# MODEM DATE START STOP _PROCOL MODEFILE CHAN S/N STAT 


006 PKRT 07116193 15:35:33 15:40:02 AMTOR ARQ AMi Q +10 OK 
007 PKRT O7/16/93 15:42:35 15:44:50 AMTOR ARQ AM2 Q +410 OK 
008 P K RT 07/16/93 15:53:07 16:00:12 PACTORF EC AM1 Q +050 K 
009 PKRT 07/16/93 16:00:50 16:04:21 PACTOR FEC AM2 Q +05 OK 
092 PKRT 07/21/93 13:52:40 13:54:57 AMTOR ARQ AM2 R 420. OK 
093 PKRT 07/21/93 14:02:19 14:05:50 PACTOR FEC AM2 ~ f& +10 ERROR 


THRUPUT (PROCESSED DATA) 
# MODEM DATE START #SEC PROCOL MODE FILE BYTES CH SIN — THRUPT 


006 PKRT 07116193 15:35:33 269 AMTOR ARQ AM1 1687 +10 OK 6.27 
+10 OK 6.19 


007 PKRT 07116193 15:42:35 135 AMTOR ARQ AM2 836 Q 
008 PKRT 07/16/93 15:53:07 425 PACTOR FEC AM1 1687 Q +05 OK 3.97 
009 PKRT 07/16/93 16:00:50 211 PACTOR FEC AM2 836 Q +05 OK 3.96 
R 
R 


© 


092 PKAT 07/21/93 13:52:40 137 AMTOR ARQ AM2 836 +20 OK 6.10 
093 PKRT 07/21/93 14:02:19 211 PACTOR FEC AM2 836 #10 ERR 3.96 vans 
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Thruput (Chars / Sec.) 


THR8GAUS July 8, 1994 


Throughput (Gaussian Noise) 
ARQ on a Single Modem 


SNR (dB) for 3 kHz Bandwidth 
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SNR (dB) for 3 KHz Bandwidth 
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Throughput (Gaussian Noise) 
Pactor ARQ 


Huffman Compression, ASCII file: 


No Compression, ASCII file 


OOOOH OOOOCHOES OOS 
. ; + 
Huffman Compression, all uppercase + 


Thruput (Chars / Sec.) 
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SNR (dB) for 3 kHz Bandwidth 
THRU2QAN July 8. 1994 


Throughput (CCIR Good) 
Pactor ARQ 


Huffman Compression, ASCII file 
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¢ Be Huffman Compression, all uppercase 


SNR (dB) for 3 kHz Bandwidth 
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